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The Fractional Quantum Hall (FQH) effect has been predicted to occur in absence of magnetic 
fields and at high temperature in lattice systems that have flat bands with non-zero Chern number. 
We demonstrate that orbital degrees of freedom in frustrated lattice systems lead to a narrowing 
of topologically nontrivial bands. This robust effect does not rely on fine-tuned long-range hopping 
parameters and is directly relevant to a wide class of transition metal compounds. 



PACS numbers: 71.10.-w , 71.27.-f-a, 73.43. Cd 

Investigating the repercussions of topology on the elec- 
tronic states in condensed matter systems has a long and 
rich history. The Integer Quantum Hall (IQH) effect, dis- 
covered 1\ in 1980, was soon understood to be a profound 
manifestation of the topological properties of the Lan- 
dau levels. The quantized Hall conductance was shown 
to be a topological invariant that classifies the ground 
state [2]. Later that decade, Haldane [3] showed that 
the IQH state is not restricted to two-dimensional (2D) 
electron gases in a strong magnetic field. It can also be 
realized in lattice systems without Landau levels, by in- 
troducing electrons on a lattice with complex hoppings 
that break time-reversal symmetry. In recent years, topo- 
logically nontrivial electronic phases were moreover dis- 
covered in time-reversal invariant insulators [IH?]; lead- 
ing to the Quantum Spin Hall effect in 2D [3 [9] and to 
the existence of protected 2D Dirac fermions on the sur- 
face of 3D topological insulators (TUl [H] and a related 
quantum Hall effect [12]. 

These presently much studied 2D and 3D topological 
insulators are time-reversal invariant lattice systems that 
can therefore be perceived as a further generalization of 
the Quantum Hall states. The generalization of Frac- 
tional Quantum Hall (FQH) states, the fractional coun- 
terpart of the IQH states, was considered only very re- 
cently [T51 - [T?| . Such a lattice FQH effect will be quite 
different from the ordinary FQH in 2D electron gases, 
for instance requiring a variational wavefunction distinct 
from the Laughlin wave function [16^ VJ^ , and it can oc- 
cur without magnetic field and potentially at high tem- 
perature |13H15j . Its realization in a material system 
would offer an exciting prospect for quantum computa- 
tion, since the presence of non-Abelian FQH states allows 
for the creation of topologically protected qbits [I8j . Cre- 
ating the analogue of the FQH effect in a lattice system 
requires the fractional filling of topologically nontrivial 
bands, which should be very narrow [T3HIS], so that the 
electron-electron interactions can dominate over the ki- 
netic energy and induce FQH states [T9]. 

The theoretical approach used to progress toward this 
goal so far relies on the fine-tuning of the electron kinetic 
energy in model Hamiltonians containing bands with the 
correct topological properties [13 15, 20^. Such a flat- 
tening procedure of the bands usually requires tuning 
(very) long-range hopping parameters to a set of quite 



peculiar strengths, which in real materials represents a 
rather formidable challenge from an experimental point 
of view. 

We consider orbital degrees of freedom as an alterna- 
tive agent for band flattening. Orbitals naturally oc- 
cur in many transition metal (TM) compounds, which 
at the same time feature strong electron-electron inter- 
actions [111152]. We concentrate on manganites, where 
Mn'^"'" ions are in a high-spin 3(i^ configuration, with 
three electrons in the more localized <2g states forming a 
spin of 3/2 and one electron in either of the two more itin- 
erant eg orbitals ferromagnetically coupled to this spin. 
Apart from other id systems besides Mn, the versatile 
class of TM oxides also contains Ad and 5c? materials with 
orbital degrees of freedom, of which ruthenates [53] and 
iridates [231 US] are important examples. 

We will show that in the presence of a chiral spin tex- 
ture, such an orbital make-up leads to nearly flat topo- 
logically nontrivial bands. It is well established that 
geometric frustration may stabilize non-coplanar spin- 
chiral magnetic textures when itinerant electrons cou- 
ple to localized spins [2B1[5U] . The Berry phase acquired 
by the electrons then leads to topologically nontrivial 
bands [571 [55[ l5Tti55] . The pronounced spatial anisotropy 
of the Bg and t2g orbitals strongly affects the symmetry of 
hopping integrals, even suppressing hopping completely 
along some directions [21]. This can result in very flat 
bands like the dispersionless bands found in several multi- 
orbital TM compounds ~ a number of antiferromagnetic 
phases in cubic manganites are stabilized by such a mech- 
anism [341 135j . Here, we report a strong orbital- induced 
flattening of topological bands in spin-chiral phases on 
frustrated kagome and triangular lattices, demonstrating 
that orbital degrees of freedom of transition-metal ions 
generically provide a route to realizing a lattice version of 
the FQH effect. We also present indications that residual 
interactions can then induce a FQH state. 

Chiral spin textures — We first summarize the situation 
on the triangular and kagome lattices for mobile charge 
carriers without orbital degrees of freedom in presence 
of a nontrivial spin-texture. The Kondo Lattice Model, 
which describes the interaction between localized (t2g) 
spins and itinerant (cg) electrons, exhibits a topologi- 
cally nontrivial chiral spin state on the triangular lat- 
tice [571l29| . This state has a four-sub-lattice ordering. 
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FIG. 1. (Color online) (a) Chiral spin ordering on the trian- 
gular lattice, (b) Spins forming a regular tetrahedron, num- 
bers refer to sites in (a), (c) Flux-phase state on the kagome 
lattice. The unit cell is indicated by the dashed hexagon and 
the gauge choice by arrows; a flux (j) threads each triangle, (d) 
Nearest-neighbor hopping geometry in lattices with triangular 
symmetry. Grey lines illustrate the oxygen octahedra, black 
front facets illustrate the triangular geometry. Thick dotted, 
dashed and solid lines indicate the bonds corresponding to 
the hopping matrices Ti, T2, and T3. Two d3z2_r2 (top) and 
d^2_y2 (bottom) orbitals are also shown. 



illustrated in Fig. [T|a) and a finite scalar spin chirality 
(Si • S2 X S3) ^ for spins on the corners of triangles. 
The situation then becomes equivalent to electrons hop- 
ping on a triangular lattice with a fictitious gauge flux of 
= 7r/2 threading each triangle, see Fig. [1] The effec- 
tive electronic Hamiltonian has a two-site unit cell |27j 
and two bands, with Chern numbers ±1, separated by 
a gap. On the kagome lattice, a staggered flux pattern, 
shown in Fig. [Tj can result from topologically nontrivial 
spin states, where a flux (j) threads each triangle and a 
flux —20 each hexagon |31j . Time-reversal symmetry is 
broken for (/) ^ 0, tt and two gaps open, leading to three 
bands. The middle band has zero Chern number, but 
the lowest and highest are topologically nontrivial with 
C = =Fsgn(sin (/)) [3T]. However, all topologically nontriv- 
ial bands have a considerable dispersion on both lattices, 
which we will now show to be substantially reduced by 
the presence of an orbital degree of freedom. 

Orbital degree of freedom — In many TM oxides, the 
TM ions are inside oxygen octahedra, which are edge- 
sharing in a triangular lattice, see Fig. [T] The cubic 
symmetry splits the TM d levels into three t2g and two 
eg orbitals. We focus mainly on the latter, but later also 
demonstrate an analogous effect for the former. Along 
the ai — (0, 1) direction, indicated by a dotted line in 
Fig. [TJ hopping for Cg orbitals conserves orbital flavor 
and is given by t [t') for the -y^) {\2iz'^ - r"^)) orbital. 
Hoppings along the other two bonds are obtained by a 
rotation in orbital space, the hopping matrices along all 
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FIG. 2. Top: kagome lattice, bottom: triangular lattice. 
Left: bands of a strip geometry, clearly showing the chiral 
edge states of the flattened bands. Right: off-diagonal Hall 
conductivity as function of chemical potential, providing the 
Chern numbers for the flat bands. For the Kagome lattice 
t' — —0.46, A = 2.75, (/> — 7r/4 and for the triangular case 
t' = -0.46, A = 2.5. 



three bonds are given by Eq. (1) in J16J. We use t as 
unit of energy and vary the material-dependent ratio t'/t 
between —1 and 1, concentrating on t'/t < inferred 
from direct overlaps of the orbitals [37] . For our fillings 
of approximately one electron per site, the Jahn- Teller 
effect is important and can induce a uniform crystal field 
i/jT = ^{nx — riz), lifting orbital degeneracy [38] . 

The two sites of the unit cell in the spin-chiral 
phase together with the two eg orbitals give a 4 x 4 
Hamiltonian in momentum space, see |36j . Figure [2] 
shows the energy bands calculated for a strip geome- 
try, with periodic boundary conditions in one direction 
and two edges in the orthogonal direction. For a large 
enough crystal-field splitting A > t,t', a gap separates 
bands with different orbital character. Within each sub- 
system, chiral magnetic order induces a further splitting 
into two topologically nontrivial bands with Chern num- 
bers C = ±1. This is unambiguously indicated by the 
topological edge states connecting the bands with C > 
and C < in Fig. [2ja). The transverse Hall conduc- 
tivity is shown in Fig. [2lb) and directly reflects the 
topological character of the oands. 

The gap between the topological bands is smaller in the 
upper ( x^—y^) sector, but robust between the two 3z^ — 

bands below the crystal-field gap. The upper band of 
the — r^ sector with C — ~1, has a weak dispersion, 
becoming nearly flat for t' « —t/2, see Fig. [2ja). The 
figure of merit quantifying the flatness is the ratio of the 
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FIG. 3. (Color online) (a) The smallest band gap over band- 
width ratios for Cg electrons the triangular lattice, for the 
gaps A/+ and Af_ indicated in Fig. [2]^ a), (b) The same for t2g 
electrons on a triangular lattice and (c) for Eg on the kagome 
lattice. Orbital splittings are indicated by A. 
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FIG. 4. (Color online) Lowest energies of the interacting Eg 
system on the triangular lattice, depending on flux inserted 
for (a) (7 = 2, 1/ = 1, and (h) U = i, V ^ 2. The ED 
results presented here were obtained for a 2 x 6 system with 
t'/t = -0.46 and A = 1.5, see [36]. 



gaps M separating it from other bands to its band width 
W. Here we monitor both the 'topological' gap (M+), 
which is induced by chiral order and the 'trivial' crystal- 
field gap (M_i), which separates it from the x^—y^ sector 
above. Figurejsj^a) shows these ratios depending on t' and 
A, the relevant figure of merit is the smaller of the two 
ratios Mj^/W and M_i/W . It is appreciable in a broad 
range of A and i', reaching a maximum of ^ 4.25 for 
A = 2.5 and t' = -0.45. 

We can also consider t2g orbitals \xy), \xz), and \yz). 
The hopping matrices are given in Eq. (2) of |36) and 
consist of inter-orbital hopping t (primarily via ligand 
oxygen ions j39j ) and orbital-conserving hopping t' due 
to direct overlap [40]. In a three- fold symmetry, the t2g 
manifold is further split into one aig and two e'g states 
separated by a crystal field iJjx HI]- Qualitatively, we 
find similar behavior as for Cg orbitals, but the figure 
of merit reaches M/W « 14, see Fig. ^h). This ex- 
traordinarily large M/W reflects the very large spatial 
anisotropy of t2g hopping integrals, well-known in trian- 
gular vanadates [31] and cobaltates [iO] . 

After discussing the triangular lattice, we now come to 
eg orbitals on the kagome lattice illustrated in Fig. [ijb) . 
The lattice has a three-site unit cell, and one proceeds 
with an approach analogous to the two-site unite cell dis- 
cussed above, for details see [Mj. Bands are again sepa- 
rated by the crystal field into two parts with a different 
orbital character, see Fig. [2] While the x"^ — sector 



is hardly gapped, the 32; 



sector shows three sub- 



bands with C = 0, ±1 similar to the one-band model ^T]. 
Again, the topological character can be inferred from 
edge states and is confirmed by the Hall conductivity 
shown in Fig. [2][d) and as for the triangular lattice, the 
top band of the Zz^ — sector (with C — +1) is very 
fiat for t' sa -t/2. The figure of merit M/W is plotted 
in Fig. [Sj^c); it reaches values up to ^ 3.5 for A ~ 2.75 
and t' = —0.45, compared to W/M ^ 1 in the one-band 
model without orbital degrees of freedom. 

FQH state induced by residual interactions — After 
showing that orbital degrees of freedom can lead to flat 
bands with Chern number C 7^ 0, we analyze the impact 
of Coulomb repulsion on the triangular-lattice Cg system. 



We include electron-electron interactions 

(1) 

where rii.Q, is the electron density in orbital a on site i, 
U acts on electrons occupying two orbitals on the same 
site, and V gives the nearest-neighbor (NN) interaction. 
Following Refs. [TSJ dH], we use Exact Diagonalization 
(ED) to study signatures of FQH-like states for a filling 
1 /3 of the topologically nontrivial flat band. For details 
on the parameters and the method, see [3S]. We find an 
approximate threefold ground-state manifold, which is an 
indication for the topological degeneracy of a FQH state. 
The three "ground states" cross each other upon inserting 
a magnetic fiuxjj^j, see Fig. iland [36^, in agreement with 
results for other models [1511431 Hi] . 

Discussion — The flattening due to the orbital degrees 
of freedom presented here can be further enhanced by 
introducing and fine-tuning longer-range hopping inte- 
grals, as in one-band models. Perfectly flat and topo- 
logically nontrivial bands {M/W — >■ 00) can in principle 
be obtained by allowing for arbitrarily long-range hop- 
pings 14;. We do not explore this here, as we aim to 
show that the anisotropy inherent in d-orbital degrees of 
freedom can robustly flatten topological bands even with 
purely NN hopping, and obtain flattening ratios up to 
M/W « 4 {M/W « 14) for Cg (^29) systems. 

Orbital degrees of freedom are directly relevant to nu- 
merous well-known TM systems. Manganese compounds 
alone, which closely correspond to the eg model studied 
here, occur in a variety of crystal structures: in simple cu- 
bic or square lattices in Lai_a;Sr2;Mn03 and LaSrMn04, 
honeycomb in e.g. Li2Mn03 or (Bi3Mn40i2)N03 but 
also in strongly frustrated pyrochlore lattices as in e.g. 
Ti2Mn207 and in triangular lattices as in YMnOs. The 
pyrochlore lattice, in particular, is realized by the S-site 
TM ions in the very common spinel crystal structure, and 
can be thought of as consisting of kagome and triangular 
layers stacked along the (1,1,1) direction. Singling out 
the triangular or kagome layers, possibly via chemical 
substitution or controlled monolayer growth, may thus 
lead to systems similar to the ones studied here. 
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A FQH ground state needs an interaction V that ex- 
ceeds the bandwidth {V > W), but remains smaller than 
the gap {V < M) so that bands are not mixed. Fortu- 
nately, TM oxides have substantial Coulomb interactions 
and NN repulsion V can become as large as or larger than 
the hoppings. On the other hand, it is almost always 
smaller than onsite repulsion, which increases one of the 
two gaps delimiting the flat band ^36j . The remaining 
challenge is thus to keep the effective interaction small 
compared to the gap separating the bands with C = ±f . 
A large figure of merit M/W provides a large window for 
this separation of energy scales W < V < M and our ED 
results in Fig. [i] suggest that one indeed has some flexi- 
bility in this regard, as interactions differing by a factor 
of two lead to similar results. The crystal field splitting 
needed to obtain the desired flattening can be varied by 
applying (chemical) pressure. Finally, many of these ma- 
terials, manganites in particular, are easy to dope which 
allows control of the (fractional) band filling. 

Theoretically, there is no fundamental objection to the 
realization of lattice FQH states, but it remains an in- 
triguing challenge from an experimental and practical 
point of view. We have demonstrated here that d-orbital 
degrees of freedom, ubiquitous in TM compounds, sub- 
stantially narrow the topologically nontrivial bands of 
electrons moving in a background of non-coplanar spins. 
The separation of energy scales is comparable to that 
achievable by long-range hopping, and we find signatures 
of a FQH-like ground state. In the search for the lat- 
tice FQH effect, geometrically frustrated TM compounds 
with an orbital degree of freedom thus come to the fore 
as a promising class of candidate systems. 
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Appendix A: Hamiltonians 

The appendices presented here correspond to the sup- 
plementary material of the published version. 



hopping matrices are 




To 




^0 t 0^ 
t 
,0 t'^ 
(A2) 



The onsite term representing the crystal field splits the 
orbital degeneracy; for the Cg orbitals, it is simply (see 
main text) 



H 



JT 



A(n, 



riz) 



-A 
A 



(A3) 



For the t2g system, the crystal field related to elongating 
or shortening the octahedra is naturally expressed in the 
{aig,e'g_^_,e'g_} basis reflecting the triangular symmetry. 
It is then given by Hjt = '^{neg+ +ne,. -2na^ J/3, which 
can be expressed in the original {xy, xz, yz} basis via the 
basis transformation defined in Ref. HHI and becomes 



H 



JT 



2n„ 



A 



^0 I V 
I I 
f 1 Oj 



(A4) 



Hamiltonians on the Triangular and Kagome 
lattices 



Even though the spin pattern underlying the chiral 
spin state on the triangular lattice has a four-site unit 
cell, the electronic Hamiltonian has only a two-site unit 
cell and can thus be described by a 2 x 2 matrix if the orig- 
inal model is a one-band model. With an underlying 
multi-orbital Hamiltonian, this becomes a Hamiltonian 
matrix consisting of four blocks (ifn, 7Ji2, H21 and H22), 
where the blocks refer to the lattice sites of the spatial 
unit cell and are matrices in orbital space, leading to 



H = 



H,jT + Hii H12 
H21 HjT^ + H22 



with 



(A5) 



Hii = -H22 = -2TiCos(k-a3), 

H12 = = -2T2 cos(k • ai) - 2if'i cos(k • aa) 



1. Hoppings and Crystal fields in orbital space 

For Cg orbitals, the hopping matrices written in the 
|3^2 _ J,2^)^ _ y2^)^T _ Q^^^ \x))^ basis are 



i / ' 4 \^/l{t' -t) 'it' +t 

If t' + 3t -Vi{t'-ty 
4 \-V^{t' ~ t) 3t' + t 



(AI) 



along ai, sl^, and as, respectively. 

For the t2g orbitals with the basis {\xy), \xz)^ |y-2^))i the 



and ai -f as = a2. The hopping matrices Ti are the 
2x2 matrice s Eg . (All for Cg electrons and the 3x3 
matrices Eq. ( A2 1 for the t2g system. The matrices i?jx 
given by the crystal field refer to Eqs. (A3) and (A4|, 
correspondingly. 
The lattice 



vectors of the 
are ai = (-1/2,-^/3/2), aa 
a3 ~ (— 1/2, \/3/2); they connect 
A, B and C of the unit cell, see Fig. 



kagome lattice 
= (1,0) and 
the three sites 
1(c) of the main 



text. With the two Cg orbitals per site/momentum, 
the basis in momentum space becomes ip (k) = 

( (k) , (k) , Vb. (k) , V'B. (k) , ^c. (k) , V-c. (k) )^ • 
The hoppings between the octahedra forming the 
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kagome lattice have triangular geometry as well, and due 
to the three-site unit cell in real space, the Hamiltonian 



consists of nine blocks, where each block is again given 



by a matrix taken from Eq. 
space. This leads to 



(Al) within the Cg-orbital 





(Mo 


Ml 






m\ 


Mo 


M2 = 






Ml 


Mo/ \ 



2fiCos(k-ai)e*'^/3 
2f3C0s(k • a3)e 



0/3 



0/3 



2TiCos(k- ai)e 
2X2 cos(k • a2)e*'^/3 



2f3C0s(k-a3)e'"^/3 
2f2Cos(k-a2)e-'"*/3 



(A6) 



The diagonal blocks Mq — Hjt refer to the crystal field 
splitting Eq. (|A3). 



3. Interacting Hamiltonian 

In our Exact diagonalization (ED, see below) studies, 
we add to the kinetic energy Eq. ( A5 1 of the eg system 
on the triangular lattice the Coulomb interaction terms 
as given in the main text. It should be noted that the 
nearest-neighbor interaction V is defined on the origi- 
nal underlying triangular lattice, i.e., the same interac- 
tion V acts both between the two real-space sites of the 
same unit cell and between sites in different unit cells, if 
these sites are nearest-neighbors on the triangular lattice. 
When adding these interactions to the Hamiltonian, we 
have to take into account that U implies an additional 
energy cost for electrons in the energetically higher [see 
Fig. 2(a) of the main text] x^ — y"^ orbitals, thus changing 
the crystal field splitting A. In our ED calculations, we 
therefore reduce A from the value A = 2.5 that would 
give the flattest band. 



Appendix B: Methods 

1. Chern number calculation 

In the main text we present the Hall conductivity as a 
proof of the topological nature of the bands. The topolog- 
ical invariant characterizing the bands, the Chern num- 
ber Cn (where n is a band label), is related to the trans- 
verse Hall conductivity as 

(TOk|J^|nk)(nk|Jy|TOk) - h-c. ^^^ ^^^^ 



(S„(k)-^,„(k))2 



— H — 

h ^" " 2nh 



d^k z • Vfe X A„(k), 



(Bl) 



BZ 



where Ji is the current operator in the i-direction, given 

by Ji = X]/c '^l(^^(^)/^^j)c/c and / is the Fermi-Dirac 
function. A„(k) is the so-called Berry connection as 
function of momentum k and defined by A„(k) — 
-i(u„(k)|Vk|u„(k)). 



2. Exact diagonalization 

Exact diagonalization studies were only performed for 
the eg triangular lattice model, because this case has the 
smallest unit cell of the models considered here. Even so, 
only very small systems are accessible. We use iV^; x Ny 
real-space sites, giving Nc — Ng/2 — xNy/2 unit cells 
of the chiral phase, but Ngp = 2Ns "generalized" orbitals 
determining the size of the Hilbert space. There is no spin 
degree of freedom, i.e., we study spinless fermions. The 
filling is the one expected to correspond to the simplest 
FQH state, i.e., 1/ = 1/3 filling of the nearly flat band. 
Since this band is close to half filling, this also implies 
a total filling of 1/3, i.e., an electron number of = 
Nsp/3. 

Due to the large number of "generalized" orbitals per 
unit cell and due to the fact that our total electron fill- 
ing is closer to half filling (which additionally increases 
the size of the Hilbert space), the lattice sizes accessi- 
ble are considerably smaller than for models considered 
previously. [151 I19j Since we need the total number of 
sites to be divisible by 3 in order to obtain 1/3 filling 
and since we also want bot Nr^ and Ny to be even, we 
consider a 2 x 6 "ladder" (Nc = 6, Ngp — 24). For sim- 
plicity, we "distort" the triangular lattice and assume the 
X direction to lie along ai and the y direction along a.2 
to be orthogonal, the third nearest-neighbor bond is still 
determined by as = ai — a2. 

The Hamiltonian is invariant under translations, hence 
total momentum constitutes a good quantum number. 
Figure [5] shows the lowest two eigenvalues within the sec- 
tors corresponding to the total momenta possible on a 
6x1 chain (the two sites in y-direction define the two- 
site unit cell in real space), and one clearly sees three 
low-energy states separated from the remaining spectrum 
by a gap. Adiabatic fiux insertion is implemented by di- 
viding the total fiux (j) in smaller phases (p/Nx added to 
each hopping process, which is equivalent to using twisted 
boundary conditions and preserves translational invari- 
ance. This replaces the two hopping matrices whose cor- 
responding lattice vectors have a component along ai, 
i.e., Ti and Tg by Tie'"^/^- and T^e^'t'/'^-. Figure 4 in 
the main text shows the evolution of the ground state 
manifold as function of the inserted fiux. The system as- 
sumes an equivalent, yet not identical, state after one 
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unit = 27r of flux is threaded through the system, 
meaning that states in the ground state manifold have 
switched places. After 3 periods of flux insertion, where 
3 corresponds to the inverse of the filling fraction, i^"^, 
with v — 1/3, we recover an identical situation as zero 
flux. Figure |6] here in the supplemental information here 
shows the same for various other parameter sets, indi- 
cating that the behavior is stable. This level crossing of 
the degenerate many body ground state manifold reveals 
the existence of the FQH ground state, provided that the 
spectral gap persists in the thermodynamic limit, in or- 
der to unambiguously exclude a charge density wave. |43| 
We cannot address larger system sizes here, but some 
progress can hopefully be made in the future. 



FIG. 5. (Color online) Lowest energies of the interacting eg 
system on the triangular lattice for the various total momenta 
of the 6x2 lattice for a few parameter sets, t' /t — —0.46 
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FIG. 6. (Color online) Lowest energies of the interacting Cg 
system on the triangular lattice, depending on flux inserted 
for various parameter sets, (c) and (e) are given in the main 
text as Fig. 4(a,b). The ED results presented here were 
obtained for a 2 x 6 system with t' /t = —0.46. 



